User interaction for visual lifelog retrieval in a virtual environment

Efficient retrieval of lifelog information is an ongoing area of research due to the multifaceted nature, and ever increasing size of lifelog datasets. Previous studies have examined lifelog exploration on conventional hardware platforms, but in this paper we describe a novel approach to lifelog retrieval using virtual reality. The focus of this research is to identify what aspects of lifelog retrieval can be effectively translated from a conventional to a virtual environment and if it provides any benefit to the user. The most widely available lifelog datasets for research are primarily image-based and focus on continuous capture from a first-person perspective. These large image corpora are often enhanced by image processing techniques and various other metadata. Despite the rapidly maturing nature of virtual reality as a platform, there has been very little investigation into user interaction within the context of lifelogging. The experiment outlined in this work seeks to evaluate four different virtual reality user interaction approaches to lifelog retrieval. The prototype system used in this experiment also competed at the Lifelog Search Challenge at ACM ICMR 2018 where it ranked first place

Serious Games Application for Memory Training Using Egocentric Images

Mild cognitive impairment is the early stage of several neurodegenerative diseases, such as Alzheimer's. In this work, we address the use of lifelogging as a tool to obtain pictures from a patient's daily life from an egocentric point of view. We propose to use them in combination with serious games as a way to provide a non-pharmacological treatment to improve their quality of life. To do so, we introduce a novel computer vision technique that classifies rich and non rich egocentric images and uses them in serious games. We present results over a dataset composed by 10,997 images, recorded by 7 different users, achieving 79% of F1-score. Our model presents the first method used for automatic egocentric images selection applicable to serious games.Comment: 11 page

Experiments in lifelog organisation and retrieval at NTCIR

Lifelogging can be described as the process by which individuals use various software and hardware devices to gather large archives of multimodal personal data from multiple sources and store them in a personal data archive, called a lifelog. The Lifelog task at NTCIR was a comparative benchmarking exercise with the aim of encouraging research into the organisation and retrieval of data from multimodal lifelogs. The Lifelog task ran for over 4 years from NTCIR-12 until NTCIR-14 (2015.02–2019.06); it supported participants to submit to five subtasks, each tackling a different challenge related to lifelog retrieval. In this chapter, a motivation is given for the Lifelog task and a review of progress since NTCIR-12 is presented. Finally, the lessons learned and challenges within the domain of lifelog retrieval are presented

Rethinking the test collection methodology for personal self-tracking data

While vast volumes of personal data are being gathered daily by individuals, the MMM community has not really been tackling the challenge of developing novel retrieval algorithms for this data, due to the challenges of getting access to the data in the first place. While initial efforts have taken place on a small scale, it is our conjecture that a new evaluation paradigm is required in order to make progress in analysing, modeling and retrieving from personal data archives. In this position paper, we propose a new model of Evaluation-as-a-Service that re-imagines the test collection methodology for personal multimedia data in order to address the many challenges of releasing test collections of personal multimedia data

Spontaneous and deliberate future thinking: A dual process account

© 2019 Springer Nature.This is the final published version of an article published in Psychological Research, licensed under a Creative Commons Attri-bution 4.0 International License. Available online at: https://doi.org/10.1007/s00426-019-01262-7.In this article, we address an apparent paradox in the literature on mental time travel and mind-wandering: How is it possible that future thinking is both constructive, yet often experienced as occurring spontaneously? We identify and describe two ‘routes’ whereby episodic future thoughts are brought to consciousness, with each of the ‘routes’ being associated with separable cognitive processes and functions. Voluntary future thinking relies on controlled, deliberate and slow cognitive processing. The other, termed involuntary or spontaneous future thinking, relies on automatic processes that allows ‘fully-fledged’ episodic future thoughts to freely come to mind, often triggered by internal or external cues. To unravel the paradox, we propose that the majority of spontaneous future thoughts are ‘pre-made’ (i.e., each spontaneous future thought is a re-iteration of a previously constructed future event), and therefore based on simple, well-understood, memory processes. We also propose that the pre-made hypothesis explains why spontaneous future thoughts occur rapidly, are similar to involuntary memories, and predominantly about upcoming tasks and goals. We also raise the possibility that spontaneous future thinking is the default mode of imagining the future. This dual process approach complements and extends standard theoretical approaches that emphasise constructive simulation, and outlines novel opportunities for researchers examining voluntary and spontaneous forms of future thinking.Peer reviewe

The practical politics of sharing personal data

The focus of this paper is upon how people handle the sharing of personal data as an interactional concern. A number of ethnographic studies of domestic environments are drawn upon in order to articulate a range of circumstances under which data may be shared. In particular a distinction is made between the in situ sharing of data with others around you and the sharing of data with remote parties online. A distinction is also drawn between circumstances of purposefully sharing data in some way and circumstances where the sharing of data is incidental or even unwitting. On the basis of these studies a number of the organisational features of how people seek to manage the ways in which their data is shared are teased out. The paper then reflects upon how data sharing practices have evolved to handle the increasing presence of digital systems in people’s environments and how these relate to the ways in which people traditionally orient to the sharing of information. In conclusion a number of ways are pointed out in which the sharing of data remains problematic and there is a discussion of how systems may need to adapt to better support people’s data sharing practices in the future

Environment change, economy change and reducing conflict at source

At a time when fossil fuel burning, nationalism, ethnic and religious intolerance, and other retrograde steps are being promoted, the prospects for world peace and environmental systems stability may appear dim. Yet now is it the more important to continue to examine the sources of conflict. A major obstacle to general progress is the currently dominant economic practice and theory, which is here called the economy-as-usual, or economics-as-usual, as appropriate. A special obstacle to constructive change is the language in which economic matters are usually discussed. This language is narrow, conservative, technical and often obscure. The rapid changes in the environment (physical and living) are largely kept in a separate compartment. If, however, the partition is removed, economics -as-usual, with its dependence on growth and its widening inequality, is seen to be unsustainable. Radical economic change, for better or worse, is to be expected. Such change is here called economy change. The change could be for the better if it involved an expansion of the concept of economics itself, along the lines of oikonomia, a modern revival of a classical Greek term for management or household. In such an expanded view, not everything of economic value can be measured. It is argued that economics-as-usual is the source of much strife. Some features are indicated of a less conflictual economy - more just, cooperative and peaceful. These features include a dignified life available to all people as of right, the word 'wealth' being reconnected with weal, well and well-being, and 'work' being understood as including all useful activity

The role of informal dimensions of safety in high-volume organisational routines:an ethnographic study of test results handling in UK general practice

Abstract Background The handling of laboratory, imaging and other test results in UK general practice is a high-volume organisational routine that is both complex and high risk. Previous research in this area has focused on errors and harm, but a complementary approach is to better understand how safety is achieved in everyday practice. This paper ethnographically examines the role of informal dimensions of test results handling routines in the achievement of safety in UK general practice and how these findings can best be developed for wider application by policymakers and practitioners. Methods Non-participant observation was conducted of high-volume organisational routines across eight UK general practices with diverse organisational characteristics. Sixty-two semi-structured interviews were also conducted with the key practice staff alongside the analysis of relevant documents. Results While formal results handling routines were described similarly across the eight study practices, the everyday structure of how the routine should be enacted in practice was informally understood. Results handling safety took a range of local forms depending on how different aspects of safety were prioritised, with practices varying in terms of how they balanced thoroughness (i.e. ensuring the high-quality management of results by the most appropriate clinician) and efficiency (i.e. timely management of results) depending on a range of factors (e.g. practice history, team composition). Each approach adopted created its own potential risks, with demands for thoroughness reducing productivity and demands for efficiency reducing handling quality. Irrespective of the practice-level approach adopted, staff also regularly varied what they did for individual patients depending on the specific context (e.g. type of result, patient circumstances). Conclusions General practices variably prioritised a legitimate range of results handling safety processes and outcomes, each with differing strengths and trade-offs. Future safety improvement interventions should focus on how to maximise practice-level knowledge and understanding of the range of context-specific approaches available and the safeties and risks inherent in each within the context of wider complex system conditions and interactions. This in turn has the potential to inform new kinds of proactive, contextually appropriate approaches to intervention development and implementation focusing on the enhanced deliberation of the safety of existing high-volume routines

Memory and mental time travel in humans and social robots

From neuroscience, brain imaging, and the psychology of memory we are beginning to assemble an integrated theory of the brain sub-systems and pathways that allow the compression, storage and reconstruction of memories for past events and their use in contextualizing the present and reasoning about the future—mental time travel (MTT). Using computational models, embedded in humanoid robots, we are seeking to test the sufficiency of this theoretical account and to evaluate the usefulness of brain-inspired memory systems for social robots. In this contribution, we describe the use of machine learning techniques—Gaussian process latent variable models—to build a multimodal memory system for the iCub humanoid robot and summarise results of the deployment of this system for human-robot interaction. We also outline the further steps required to create a more complete robotic implementation of human-like autobiographical memory and MTT. We propose that generative memory models, such as those that form the core of our robot memory system, can provide a solution to the symbol grounding problem in embodied artificial intelligence

The Spread of Inequality

The causes of socioeconomic inequality have been debated since the time of Plato. Many reasons for the development of stratification have been proposed, from the need for hierarchical control over large-scale irrigation systems to the accumulation of small differences in wealth over time via inheritance processes. However, none of these explains how unequal societies came to completely displace egalitarian cultural norms over time. Our study models demographic consequences associated with the unequal distribution of resources in stratified societies. Agent-based simulation results show that in constant environments, unequal access to resources can be demographically destabilizing, resulting in the outward migration and spread of such societies even when population size is relatively small. In variable environments, stratified societies spread more and are also better able to survive resource shortages by sequestering mortality in the lower classes. The predictions of our simulation are provided modest support by a range of existing empirical studies. In short, the fact that stratified societies today vastly outnumber egalitarian societies may not be due to the transformation of egalitarian norms and structures, but may instead reflect the more rapid migration of stratified societies and consequent conquest or displacement of egalitarian societies over time